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Abstract. We consider symmetric tensors of format 3x3x3 over the prime 
fields F2 and F3 , and compute their equivalence classes under the action of the 
direct product of general linear groups. We use computer algebra to determine 
the set of tensors of each symmetric rank, then we compute the orbit of the 
group action. We determine the maximum symmetric rank of these tensors 
over F2 and F3. 



1. Introduction 

A tensor is a multidimensional array of numbers. Formally, an order-fc tensor 
is an element of the tensor product of k vector spaces. A first order tensor is a 
vector, and a second order tensor is a matrix. The rank of a tensor is the minimal 
number of terms in its expression as a sum of simple tensors. See Cichocki et al. 
[13] for a recent survey of matrix and tensor decomposition algorithms, as well 
as applications in areas such as data mining, email surveillance, gene expression 
classification, and signal processing. See also Kroonenberg [34^, and Smilde et al. 
[45] ■ and references therein. 

A tensor is called symmetric if its elements remain fixed under any permutation 
of the indices. Then analogously we can define the symmetric rank of a sym- 
metric tensor to be the minimal number of terms in its expression as a sum of 
simple symmetric tensors. Further, we can associate a homogeneous polynomial 
in F[.To, . . . , Xn]d to any symmetric tensor X G S'^V, and the determination of the 
symmetric rank of X is equivalent to the Big Waring Problem: determining the 
minimum integer r such that a generic form of degree d in n + 1 variables can be 
written as a sum of r dth powers of linear forms . 

The determination of canonical forms of tensors is a generalization of the matrix 
case. For any m x n matrix A (with m < n) there exist invertible matrices P G 
GL„(F) and Q G GL„(F) such that 



PAQ 



Ir 




where Ir is the r x r identity and r < m is the rank. The matrix PAQ is called the 
Smith normal form (canonical form), and is the orbit representative for the action 
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of GLm(F) X GL„(F), the direct product of general linear groups. When m,n = 2, 
there are three canonical forms, 



"0 


0' 




1 


0' 




'1 


0" 








1 








5 





1 



Determining the canonical forms of order-fc tensors for A; > 2 is a more complicated 
problem. For the next simplest case, consider 2x2x2 tensors. Le Paige (1881) 
determined there are 7 canonical forms over C [38] . and later Oldenburger deter- 
mined there are 8 over K |42| . We considered the same problem over the prime 
fields F2 and F3 f? . The maximum rank of these tensors over R, C, and the prime 
fields we considered is 3. For larger tensor formats over K and C, the problem is 
more complicated and, in general, there is not a finite classification [17^. 

In previous work, we considered the same problem of determining canonical 
forms over prime fields, but restricted our attention to symmetric tensors. For the 
2x2x2 and 2x2x2x2 symmetric formats over R and C, this problem was 
analyzed independently by Gurevich (26j first, then by Weinberg [5^. In [ITj, we 
extended these results by determining the canonical forms of 2 x 2 x 2 symmetric 
tensors over the prime fields Fp for p = 2,3, 5, 7, 11, 13, 17, as well as 2x2x2x2 
symmetric tensors over Fp for p = 2, 3, 5, 7. 

In this paper, we continue in this direction by considering 3x3x3 symmetric 
tensors over F2 and F3. In each case, we compute the symmetric tensors of each 
rank. The direct product of general linear groups partitions the tensors of each 
rank into a disjoint union of orbits, where the tensors in each orbit are equivalent. 
The elements are arranged in lexical order and the minimal element is the canonical 
form of its orbit under this group action. We comment here that due to limited 
computer memory, we are not able to consider larger prime fields, or other tensor 
formats. 

2. Preliminaries 

An order-fc tensor X is an element of the tensor product of fc vector spaces 
Vi (8) • ■ ■ €5 Vfe, where the order refers to the number of dimensions. Once we fix a 
basis in each vector space, we can associate to X a, fc-dimensional array. Then an 
order-1 tensor is a vector, an order-2 tensor is a matrix, and we denote an order-fc 
tensor of format di x ■ ■ ■ x dk a.s [xi-^,,,i^.] G F'^^^ "^'*''. We can represent the tensor 
X in vectorized (flattened) form by writing the columns of X in a vector format, 
where the entries are in lexical order of the fc-tuples of the subscripts. 

An order-fc tensor [a;ii...ifc] G F"^ "^" is called symmetric if 

for all permutations tt e S'^ |16| . 

Proposition 1 (Proposition 3.7 [16^). Let X = [xj^ . i^.] €E F"^"'^" be an order-k 
tensor. Then 

t:{X) = X 

for all permutations n Cz Sk if and only if 
for all permutations i: £ Sk- 
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In this paper we consider 3x3x3 symmetric tensors. Such a tensor satisfies 

•^ijk — "^ikj — -^jik — -^jki — ^kij — -^kji: 

for aU k G {1, 2, 3}. We will denote the set of all order-fc, n-dimensional sym- 
metric tensors over the field F by S^(F'"-) C F"^ "^". The set of such tensors 
satisfies the property 7r(X) = X for aU tt e Sk and X e S'' {¥"■). 

Definition 2. A tensor X E tS'^(F") is called simple symmetric if it can be 

written as 

X = u ($1 ■ ■ ■ ^ u 

with fc-many non-zero vectors u G F". The (ii, . . . , ife)th entry of X is 

Definition 3. A tensor has symmetric outer product rank s if it can be written 
as a sum of s (and no fewer) symmetric simple tensors, 

x=j2ur. 

We write rank5(A') to denote the symmetric outer product rank of X . 

The only rank-0 symmetric tensor is the zero tensor. We will drop the words 
outer product and simply say symmetric rank. 

Definition 4. The maximum rank is defined to be 

max{rank(X) | X e wd^x-xd^-^^ 

If we replace rank(A') with ranks (X) we get the analogous definition of maximum 
symmetric rank. 

In order to compute the canonical forms of symmetric tensors we use a tensor- 
matrix multiplication. Multilinear matrix multiplication is a tensor-matrix 
multiplication that allows us to multiply matrices on each of the modes of the 
tensor, li X = [xi,...,,] e f"^ix->^dk ^nd 

then Y ^ {Ai,...,Ak) ■ X ^ [?/iii...«J e F'=i^ "^'='= is the new tensor defined by 

E(i) (fe) 

ii,...,ife = l 

Since we are restricting ourselves to symmetric tensors, we impose the condition 
that Ai — ■ ■ ■ — Ak, otherwise, multilinear matrix multiplication can transform a 
symmetric tensor into a non-symmetric tensor. 

Definition 5. The group GLdj^^,,,^di^{¥) :— GLdi{¥) x ••■ x GLd^{¥) acts on an 
order-fc tensor by changes of basis along the fc modes. 

We consider the action of the symmetry group GL3^3^3(Fp), which does not 
change the rank of a tensor [l7j. The action of this group decomposes the set 
of order-fc symmetric tensors into a disjoint union of orbits, where the tensors in 
each orbit are equivalent under the group action. The orbit of X is the set 

Ox ■.= {ig,g,g)-X\geGL3i¥p)}. 
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We define the canonical form of X to be the minimal element in its orbit with 
respect to the lexical ordering. 

3. Symmetric Tensors of Format 3x3x3 

Every order-fc symmetric tensor of dimension n may be uniquely associated with 
a homogeneous polynomial (also called a quantic) of degree fc in n variables [16j . 
The problem of determining symmetric rank is equivalent to the Big Waring Prob- 
lem: determining the minimal number of pth powers of linear terms [21j |22j . The 
Alexander-Hirschowitz (AH) Theorem [1] completely describes the calculation of 
the generic rank of symmetric tensors. 

In Dickson's 1908 paper TH', he cites that a complete set of canonical forms of 
ternary cubics was determined over C, and that he treats the case in which the field 
F has the modulus 3. He shows there are 11 distinct canonical forms. 

Kogan and Maza i32j determined the equivalence classes of ternary cubics under 
general complex linear changes of variables using a computational approach. See 
in particular Theorem 5 of |32) . Their contribution provided a method of comput- 
ing the signature manifolds for each of the equivalence classes, and their algorithm 
matches a cubic with its canonical form while producing the required linear trans- 
formation explicitly. 

3.1. Algorithms. Using computer algebra, we generate all the symmetric tensors 
in each symmetric rank. Then we apply the group action which decomposes the set 
of tensors within each rank into a disjoint union of orbits. The minimal element of 
each orbit with respect to the lexical ordering is the canonical form. 

We compute the symmetric tensors in each symmetric rank in the following way. 
We begin by generating the set of simple symmetric tensors. Suppose the set of 
symmetric tensors of ranks (r) have already been computed. Then for all X with 
rank5(l) and Y with ranks (r) we consider rank5(Ar + y). Clearly, rank5(Ar + y) < 
(r + 1), thus we only retain the symmetric tensors whose sum has symmetric rank 
strictly equal to r -I- 1 . 

Next we apply the action of the direct product of general linear groups to de- 
compose the tensors in each rank into a disjoint union of orbits. The pseudocode 
is provided in Table [1] This algorithm was used in our previous paper |47| , and is 
a modification of the original algorithm used in |7] to determine canonical forms 
without the symmetry condition imposed on the tensors. 

3.2. Canonical Forms of 3 X 3 X 3 Symmetric Tensors over F2. There are 1024 
3x3x3 symmetric tensors over F2. Only 128 (12.5%) of these have a symmetric 
decomposition. The maximum symmetric rank is 7. The symmetric ranks, orders 
of each orbit, and the minimal representatives (in fiattened form) of each orbit 
are given in Table O To make the canonical forms more legible we replace the 
zero entries with •. The number of tensors in each symmetric rank is listed below 
(percentages add to 12.5%). 

rank 1 2 3 4 5 6 7 

number 1 7 21 35 35 21 7 1 

« % 0.10% 0.68% 2.05% 3.42% 3.42% 2.05% 0.68% 0.10% 
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unf latten(a;) 

set t 

for k — 1,2,3 do: set t t + 1; set y^fe Xt 
return(y) 

groupaction((7, x, m) 
set y ^ unf latten(x) 
if m = 1 then for j, k ^ 1,2,3 do: 
set V ^ [yijk, y2jk]; 

set w ^ [giiVi+gi2V2+gi3V3modp, 53i«i+532W2+533W3 modp] 

for 1 = 1,2,3 do: set y^fc <— Wi 
if m — 2 then . . . (similar for second subscript) 
if m = 3 then . . . (similar for third subscript) 
return( f latten( y ) ) 

smallorbit(x) 
set result ^ { } 
for a G GLsiFp) do: 

set y groupaction(a, x, 1) 

set z groupaction(a, y, 2) 

set w <— groupaction(a, z, 3) 
set result ^ result U {w} 
return( result ) 

• for r = 0, . . . , maximumrank do: 

set representatives[r] ^ { }; set remaining ^ arrayset[r] 
while remaining 7^ { } do: 

set X remaining[l]; set xorbit <— largeorbit(a;) 

append xorbit[l] to representatives[r] 

set remaining <— remaining \ xorbit 

Table 1. Algorithm for group action (pseudocode) 



3.3. Canonical Forms of 3 x 3 x 3 Symmetric Tensors over F3. There are 
59,049 3 x 3 x 3 symmetric tensors over F3, and unlike in the previous case, every 
symmetric tensor has a symmetric decomposition. The maximum symmetric rank 
is 7. The symmetric ranks, orders of each orbit, and the minimal representatives 
of each orbit are given in Table [3l The number of tensors in each rank is listed in 
the table below. 

rank 0123 4 5 67 

number 1 26 312 2288 11440 30342 14352 288 

« % 0.00% 0.05% 0.53% 3.87% 19.37% 51.38% 24.31% 0.49% 

At this time, larger prime fields and larger tensor formats cannot be dealt with 
by our computer algorithms in a reasonable amount of time. There are over 9.7 
million simple symmetric 3x3x3 tensors over F5. 
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symmetric rank orbit size canonical form (flattened) 
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Table 2. Canonical forms of 3 x 3 x 3 symmetric tensors over F2 



4. Conclusion 

We began by summarizing known results, and our own previous work about 
canonical forms of tensors (symmetric and non-symmetric). For third order tensors, 
the simplest case for the classification of canonical forms is for 2x2x2 tensors. 
The classification over R and C has appeared many times throughout the literature. 
In previous work, we extended the results by determining the canonical forms of 
2x2x2 tensors over the prime fields ¥p for p = 2, 3, 5. We also examined the same 
problem for the larger tensor format 2x2x2x2 over Fp for p = 2, 3, where the 
choice of p is restricted by the memory capabilities of our computer. 

Next, we summarized known results about 2x2x2 symmetric and 2 x 2 x 
2x2 symmetric tensors. The canonical forms of these tensor formats have been 
enumerated in the past over M and C by Weinberg 52] and Gurevich ^26 . In recent 
work, we extended these results by determining the canonical forms over ¥p. For 
the third order case, we considered all primes p < 17. For the fourth order case, 
we considered p < 5. 

In this paper, we determined the canonical forms of 3 x 3 x 3 symmetric tensors 
over Fp for p = 2,3. We determined that the maximum symmetric rank over finite 
fields is at least 7. Due to memory limitations we could not consider larger primes, 
nor could we consider 3x3x3x3 symmetric tensors (or any other symmetric 
tensor formats, for that matter). 
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